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Some effort has been undertaken over the last decade to provide 
conditions for the control of the false discovery rate by the linear step- 
up procedure (LSU) for testing n hypotheses when test statistics are 
dependent. In this paper we investigate the expected error rate (EER) 
and the false discovery rate (FDR) in some extreme parameter config- 
urations when n tends to infinity for test statistics being exchangeable 
under null hypotheses. All results are derived in terms of p- values. In 
a general setup we present a series of results concerning the interrela- 
tion of Simes' rejection curve and the (limiting) empirical distribution 
function of the p- values. Main objects under investigation are largest 
(limiting) crossing points between these functions, which play a key 
role in deriving explicit formulas for EER and FDR. As specific ex- 
amples we investigate equi-correlated normal and t-variables in more 
detail and compute the limiting EER and FDR theoretically and nu- 
merically. A surprising limit behavior occurs if these models tend to 
independence. 

1. Introduction. Control of the false discovery rate (FDR) in multiple 
hypotheses testing has become an attractive approach especially if a large 
number of hypotheses is at hand. The first FDR controlling procedure, a 
linear step- up procedure (LSU), was originally designed for independent p- 
values (cf. [1]) and has its origins in [3] (cf. also [14]). Meanwhile, it is 
known that the LSU-procedure controls the FDR even if the test statistics 
obey some special dependence structure. Key words are MTP2 (multivari- 
ate total positivity of order 2) and PRDS (positive regression dependency 
on subsets). More formal descriptions of these conditions and proofs can be 
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found in [2] and [13] . In view of testing problems with some ten thousand 
hypotheses as they appear, for example, in genetics, asymptotic considera- 
tions become more and more popular. The first asymptotic investigations 
concerning expected type I errors of the LSU-procedure, as well as for the 
corresponding linear step-down (LSD) procedure for the independent case, 
can be found in [7] and [8] . A first theoretical comparison of classical stepwise 
procedures controlling a multiple level a [or familywise error rate (FWER) in 
the strong sense] based on asymptotics is given in [5] . Moreover, attempts to 
improve the LSU-procedure and interesting investigations based on asymp- 
totics can be found, for example, in [9, 10] and [16]. 

The LSU-procedure is based on the critical values on- n = ia/n, i = 1, . . . , n, 
introduced in [15] in a different context. Based on ordered p-values 
Pi-.n < • • • < Pn-.n, the LSU-procedure rejects the corresponding hypotheses 
Hi :n , . . ., H m - n , where m = max{i :pi- n < o?j :n }. The corresponding LSD-pro- 
cedure rejects i?i :n , . . . , H r:n , where r = max{i :pj- n < aj :n for all j = 1, . . . , i}. 
Since m > r, the LSU-procedure may reject more hypotheses than the LSD- 
procedure, never less. In this paper we restrict attention to the LSU-procedure, 
which can be rewritten in terms of the empirical c.d.f. (e.c.d.f.) F n (say) of 
the p^s. Setting t* = sup{t:F n (t) > t/a}, Hi is rejected iff pi < t* . The re- 
jection curve r a (t) = t/a will be called the Simes-line. Note that oti- n = 
r~ l {i/n). The threshold t* will be called the largest crossing point (LCP) 
between the e.c.d.f. and the Simes-line and plays a crucial role in this paper. 

FDR control for a multiple test procedure is defined as follows. Let V n 
denote the number of falsely rejected null hypotheses and let R n denote 
the number of all rejections. Then the FDR (depending on the underlying 
parameter configuration i? G 0, say) is defined by 



FDR n (-#) = E 
and is said to be controlled at level a if 



supFDR n (i?) < a. 

i960 

The ratio V n /[R n V 1] is the false discovery proportion (FDP). In the case 
of independent p-values both LSU and LSD control the FDR at level a; 
more precisely, if G is such that exactly no hypotheses are true and the 
remaining n± = n — uq ones are false, for both LSU and LSD, the actual 
FDR is bounded by n^a/n. Under weak additional assumptions, we have in 
this setting for the LSU-procedure 

FDR n (i9) = ^a. 

n 

Different proofs for this fact can be found in [1, 7, 13] and [16]. 
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In [8] the expected number of type I errors (ENE), that is, ENE n (i?) = 
E[Vy, of LSU and LSD was investigated for the case that all hypotheses 
are true and p-values are independent. In this case the limiting ENE for 
n — > oo equals a/(l — a) 2 for LSU and a/(l — a) for LSD. Moreover, in [7] 
the expected type I error rate (EER) defined by EER n (£) = E[V^/n] was 
studied if a proportion 1 — £ of hypotheses is totally false, that is, with p- 
values equal to zero with probability 1. For independent p- values, it was 
shown in [7] under quite general assumptions that for both LSU and LSD 

= (1 - Vl-af/a = a/4 + a 2 /8 + 0(a 3 ) « a/4. 

The worst case for the EER appears if the proportion of true hypotheses 
tends to ( = (1 — sjl — a)/a = 1/2 + a/8 + 0(a 2 ), and, for small values of 
a, the expected type I error rate is then approximately a/4. 

In this paper we investigate the behavior of EER and FDR of the LSU- 
procedure based on dependent test statistics if the number of hypotheses 
tends to infinity. It will be assumed that test statistics are exchangeable 
under the corresponding null hypotheses. The main issue will be the calcu- 
lation of the limiting values of the actual EER and FDR in some extreme 
parameter configurations, where a proportion £ n of hypotheses will be as- 
sumed to be true and the remaining hypotheses will be assumed to be totally 
false. These configurations are least favorable for the EER, that is, EER be- 
comes largest under these configurations if £ n is given. Theoretical results 
on least/most favorable configurations for the FDR (configurations where 
the FDR becomes largest /smallest) under dependence remain a challenging 
open problem. However, simulations indicate that extreme configurations 
(no hypotheses true, n\ hypotheses totally false) are first candidates for 
least favorable configurations and therefore of special theoretical interest. 
Until now, not many results are available concerning the behavior of EER 
and FDR under dependence. A brief discussion on expected type I errors 
for single-step procedures based on exchangeable test statistics and range 
statistics can be found in [6]. 

In Section 2 we develop a general theory for the computation of the lim- 
iting EER and FDR assuming that exchangeable test statistics of the type 
Tj = g(Xi, Z) are at hand. The results heavily depend on the limit behavior 
of the e.c.d.f. of the underlying p-values given the value z of the distur- 
bance variable Z . Generally, the limiting e.c.d.f. -Fqo (say) of dependent 
p-values differs substantially from that of independent p-values. Formulas 
for the limiting e.c.d.f. and crossing point determination are summarized 
in Lemma 2.1. For £ n — > ( ^ 1, limiting EER and FDR are computed in 
Theorems 2.1 and 2.2 in terms of the set of largest crossing points (LCP's) 
between and the Simes-line. The case £ n — ► 1 is more complex because 
limiting LCP's can be zero. For the latter case, we derive some important 
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technical results for the FDR in Lemmas 2.2 and 2.3 supposing that the c.d.f. 
of a proportion of p-values is linear in a neighborhood of zero. The limiting 
EER and FDR are then computed in Theorems 2.3 and 2.4. Moreover, we 
give an example where the FDR is exactly the same as in the independent 
case. By utilizing the results of Section 2, we investigate equi-correlated nor- 
mal variables in Section 3 and jointly studentized t-statistics in Section 4. 
The corresponding formulas for the limiting EER and FDR are given in 
Theorems 3.1 and 3.2 and Theorems 4.1 and 4.2, respectively. A surprising 
behavior of the FDR occurs if these models tend to independence and the 
proportion of false hypotheses tends to 0; see Theorem 3.3 and Theorem 4.3. 
Some figures in Sections 3 and 4 illustrate the limiting behavior of EER and 
FDR. The numerical and computational effort for these graphs was enor- 
mous. A few concluding remarks are given in Section 5. Short proofs are in 
the main text, while more technical proofs are deferred to the Appendix. 

2. Exchangeable test statistics: general considerations. We first consider 
the following basic model with exchangeable test statistics. Let Xi, i = 
1, . . . , n, be real- valued independent random variables with support X . More- 
over, let Z be a further real- valued random variable, independent of the AVs, 
with support Z and continuous c.d.f. Wz- Denote the c.d.f. of Xi by Wj. 
Suppose the c.d.f. Wi depends on a parameter i?j € [$o,oo), where $o is 
known. Without loss of generality, it will be assumed that $o — 0. Consider 
the multiple testing problem 

Hi:$i = versus Ki > 0, i = 1, . . . , n. 

Suppose that T, = g{X. L ,Z) (with support T) is a suitable real- valued test 
statistic for testing Hi such that Tj tends to larger values if $j increases. In 
Section 3 we consider statistics of the type Tj = g(Xi, Z) = Xi — Z and in 
Section 4 Tj = g(Xi,Z) = Xi/Z; see Examples 2.1 and 2.2 below. The sets 
X, Z and T are assumed to be intervals. For convenience, we assume in this 
section that g is continuous, strictly increasing in the first and either strictly 
monotone or constant in the second argument. Moreover, let g\ denote the 
inverse of g with respect to the first argument of g, that is, g(x, z) = w iff x = 
gi(w,z). If g is strictly monotone in the second argument, we denote the 
inverse of g with respect to the second argument by g2, that is, g{x,z) = 
w iff z = g2(x, w). 

In the case that Hi is true, the c.d.f. of X{ (Tj) will be denoted by Wx 
(Wt) and Wx is assumed to be continuous. For Z = z, we define p-values 
Pi = Pi{z) as a function of z by 

(2.1) pi(z) = l-W T (g(xi,z)), i = l,...,n. 

The ordered p-values are given by Pi- n {z) = 1 — WT(g(x n -i + i :n , z)). Under 
Hq = fllLi Hi, the e. c.d.f. of the p- values is denoted by F n (-\z). 
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Remark 2.1. It is important to note that, given Z = z, the p- values 
Pi(z), i = 1, . . . ,n, can be regarded (a) as conditionally independent random 
variables 1 — WT(g(Xi, z)) with values in [0, 1], or, (b) under Hq, as realiza- 
tions of conditionally i.i.d. random variables with a common c.d.f. F^^z) 
(say). In the latter case, given Z = z, it holds that F n (-\z) — > i ? 00 (-|z) in 
the sense of the Glivenko-Cantelli theorem. Therefore, we refer to as 
the limiting e. c.d.f. [of the p-values Pi(z)]. In view of (2.1), we get Foo^z) = 
P(Pi(z) < t) = 1 - P(W T (g(Xi,z)) <l-t) = l- P(g(Xi, z) < Wf\l - *)) = 
l-P(Xi < gi{W^ l {l-t),z)), hence, since Wx is assumed to be continuous, 

(2.2) F 00 (t\z) = l-Wx{gi{W^ l {l-t),z)), *e(0,l). 

For the sake of simplicity, it will be assumed that the model implies that 
Foo(t\z) is continuous in t 6 [0, 1] and differentiable from the right at t = 
with Foo(0|z) = for all z £ Z. 

In the case that a proportion £ n = no/n of hypotheses is true and the rest 
is false, that is, no hypotheses are true and n\ = n — riQ hypotheses are false, 
we make the following additional assumption in order to avoid laborious 
limiting considerations as i?j — > oo under Ki. It will be assumed that under an 
alternative Ki : #j > 0, the parameter value #j = oo is possible. Moreover, for 
•&i = oo, it will be assumed that the p- value pi has a Dirac distribution with 
point mass in 0. We refer to this situation as the D-EX(£ n ) model. As briefly 
mentioned in the introduction, under suitable assumptions, EER becomes 
and FDR seems to become largest if $j — ► oo for all i with i?j€ Ki. In order to 
calculate upper bounds for EER and FDR, we therefore restrict attention to 
the D-EX(£ n ) model which rarely (never) appears in practical applications. If 
one is interested in EER and FDR under other parameter configurations, one 
may put a prior on the $j 's under alternatives Ki , which results in a mixture 
model as considered, for example, in [9] or [16]. This makes things slightly 
more complex and will not be considered in this paper. In the D-EX(£„) 
model, the e. c.d.f. of the p-values will be denoted by F n (-\z,(n)- 

The following two examples fit in the D-EX(£ n ) model and will be studied 
in more detail in Sections 3 and 4, respectively. 

Example 2.1. Let Xi ~ N(0, 1), i = 0, . . . ,n, be independent standard 
normal random variables and let Tj = #i + ^fpXi — y/pXo with $j > 0, i = 
l,...,n, where p € (0,1) is assumed to be known and p = 1 — p. Then 
T = (Ti, . . . ,T n ) is multivariate normally distributed with mean vector i? = 
. . . ,i9n), Var[Ti] = 1 for i = 1, . .. ,n, and Cov(Ti,Tj) = p for 1 < i ^ 
j < re. Consider the multiple testing problem Hi : $j = versus Ki'.'&i > 0, 
i = 1, . . . ,n. This setup includes the well-known many-one multiple compar- 
isons problem with underlying balanced design. For p£ (0,1), the distri- 
bution of T is MTP2 so that the Benjamini-Hochberg bound applies; cf. 
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[2] or [13]. Note that Z is replaced by X and W x = W Xa = W T = $, where 
$ denotes the c.d.f. of the standard normal distribution. Suitable p-values 
for testing the H^s are given by pi = Pi(xo) = 1 — + \fj)Xi — ^/pxo), 
i = 1, ... ,n. Again, we add = oo to the model such that pi = a.s. if 
^ = oo, i = 1, . .. ,n. We denote this D-EX(Cn) model by D-EX-N(Cn)- 

Example 2.2. Let A, ~ A($j,cr 2 ), i = 1, . . . ,ra, be independent normal 
random variables and let vS 2 /a 2 ~ be independent of the Aj's. Without 
loss of generality, we assume a 2 = 1 and the c.d.f. of y^S* will be denoted 
by F Xv . Again we consider the multiple testing problem Hi : i?j = versus 
Ki : $j > 0, z = 1, ... ,7i. Let Tj = Xi/S, i = 1, . . . ,ti. Then T = (Ti, . . . , T n ) 
has a multivariate equi-correlated t-distribution. The c.d.f. (p.d.f.) of a uni- 
variate (central) t-distribution will be denoted by F tl/ (ft v ) and a /3-quantile 
of the ^-distribution will be denoted by t v p. Here Z is replaced by S, 
Wx = 3>, Ws(s) = F Xv (s/^) and Wt = F tv . Suitable p- values (as a func- 
tion of s) are defined by Pi(s) = 1 — F tv {xi/s). Again we add $j = oo to 
the model such that Pi = a.s. if i?j = oo. We denote the corresponding 
D-EX(Cn) model by D-EX-t(Cn)- It is outlined in [2] by employing PRDS 
arguments that the Benjamini-Hochberg bound applies in this model for 
a 6 (0, 1/2). 

The following obvious lemma gives explicit expressions for F^ (as a con- 
sequence of the Glivenko-Cantelli theorem, cf. (2.2) in Remark 2.1) and 
characterizes crossings with the Simes-line in the D-EX(£ n ) model. 

Lemma 2.1. Given D-EX(( n ) with lim 

n^>oo Cn — C £ (0) 1]> the limiting 

e. c.d.f. of the p-values is given by 

Foo(*|z, C) = (1 - C) + C(l - W x (jgi(Wf\l - t),z))), t e (0, 1). 

Moreover, Fqo crosses (or contacts) the Simes-line, that is, F^lplz, Q = 
t/a for some t E (a(l - (),a) iff W^{{1 - t/a)/() = g^Wf^l - t),z). If 
Foo(t\z) i s strictly decreasing in z for all t G (a(l — (),a) and if F^^zX) 
= t/a for some t* £ (a(l — £), a), then 

z = z(t*\C) = g 2 (W x 1 ({l - t*/a)IQ,W^{\ - t*)). 

Note that -Foo(i|z) = Foo(t|z, 1). Analogously, we set z{t) = z{t\l). 

Figure 1 illustrates the enormous impact of the disturbance variable and 
a large correlation in the D-EX-N(£ n ) model on the LCP determining the 
number of rejections. In this example, for xq = 0.0 only the (totally) false 
hypotheses are rejected, while for xq = —2.0 we obtain 38 false rejections. 
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Remark 2.2. Under the assumptions of Lemma 2.1, the Glivenko- 
Cantelli theorem yields 

lim sup \F n (t\z, Cn) — Fooftlz, ()\ = almost surely for all z £ Z. 

n ^°°te[o,i] 

Moreover, 

E[F 00 (t\Z,()] = J F 00 (t\z,()dP z (z) = 1-C + C* for all t G [0, 1]. 

For linin^oo Cn = C G (0, 1] , define 
(2.3) t(z|C) = sup{t G [a(l - C), a] : F^z, Q = t/a}. 

If there exists an e > such that Foo(t|z,C) > t/a for all t G [i(z|C) ~~ 
e,t{z\Q) and Foo(t|z,C) < t/a for all t 6 (i(z|C), t(^|C) + e], then t(z|C) will 
be called the largest crossing point (LCP) of F 00 (-|z,C) and the Simes-line. 
The set of LCP's will be denoted by Cf . Moreover, set = {z £ Z : t(z\() £ 
C^}. Note that there may be some tangent points (TP's) t(z\() defined by 
(2.3) with Fqo^IzX) < t/ a in a neighborhood of t(z\C)- However, it will be 
assumed that P z (Dq) = 1. In practical examples, is a finite union of 
intervals. For £ £ (0, 1), we always have a well defined LCP or TP t{z\Q) > 
a{l — Q > 0. For £ = 1, the LCP may be for a large set of z-values, which 
makes the calculation of the limiting EER and FDR subtler. 

In the following we make use of the notation 




0.0 0.2 OA 0.6 0.8 1.0 O.D 0,01 0.02 0.03 0.04 0.05 



t 1 

Fig. 1. The Simes-line for a — 0.05 and two realizations of the e.c.d.f. F n (-\xo) together 
with F 00 (-|a;o) in the D-EX-N(( n ) model for n = 50, Cn = 0.9, p = 0.95 and x = 0.0 (left 
picture with t € [0, 1]), xq = —2.0 (right picture with t £ [0,0. 05]). 
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FDR 00 (C|z) = lim FDR n (C„|z), FDR oo (0 = lim FDR„(C„), 

n-+oo n— >CO 

and the corresponding expressions for EER. Moreover, the notation V n (z), 
R n {z) will be used if Z = z is given. 

2.1. All LCP's greater than zero. We first consider the case £ G (0, 1). 

Theorem 2.1. Given D-EX(( n ) with lim^oo Q n = £ G (0, 1), /or a// 2 G 



(2.4) 
(2.5) 



lim 

n^oo R n ( z ) V 1 



q(i-C) 

«(*io 



a.s., 



a.s. 



Proof. With a similar technique as in the proof of Lemma A. 2 in [7], it 
can be shown that the proportion of rejected hypotheses R n {z)/n converges 
almost surely to t(z\C)/a. This fact immediately implies (2.4) and (2.5). □ 

Remark 2.3. Under the assumptions of Theorem 2.1, 



(2.6) EER oc (C\z)=K 

(2.7) FDR 00 (C|^)=E 



V n (z) 



lim 

71 — >OQ fl 

V n (z) 



t(z\0 



a 



lim 

n^oo Rniz) V 1 



-(i-C), 

a(l-C) 
t(z\C) ■ 



In view of the general assumption P Z (D^) = 1, z can be replaced by Z in 
(2.4) and (2.5). 

It remains to calculate EERoo(^) and FDRoo(£). This may be done in two 
ways. The first is to integrate (2.4) and (2.5) with respect to P z . In this case 
the main problem is the computation of t(z\(), which can be cumbersome. 
In general, t(z\C) cannot be determined explicitly. The second possibility 
seems more convenient and is summarized in the following theorem. 

Theorem 2.2. Under the assumptions of Theorem 2.1, suppose that 
F<x(t\z) i s strictly decreasing in z for t G (a(l — Q, a). Let C^i = {t/a — 1 + 
(:t £ CJ, C ?i2 = {1 - a(l - C)/t:t G C ( } and denote the c.d.f. of 
\im n ^ 00 V n (Z)/n and lim n _ +£JO V^(Z)/(i2 n (Z) V 1) by G^i and G^ 2 , respec- 
tively. Then 

(2.8) G f> i(u) = l-Wz(z(a(« + 1-010) /or u G C^i n (0,0, 

'a(l-C) 



(2.9) G C o(u) = l-Wz(z 



1-u 



for ueC C2 n (0,0, 
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hence, EERqo and FDRqo can be computed via 

EERoo(C)= / udG (>1 (u) and FDRoo(C) = f udG C2 (u). 

Proof. Let C G (0, 1) and t G C ? n (a(l -Q,a). From (2.4) in Theorem 
2.1, we get 

LeD c : lim > - - (1 - C) a.s. }={zeD ( :z< s(t|C)}. 

L rwoo n a J 

Hence, the substitution u = t/a — (1 — Q yields that for all u G C^i n (0, £) 

W^(a(u + l-C)|C)) = W(^^C : lim >--(l-C) a.s. 

= 1-G fl i(«), 

which is (2.8). Similarly, we obtain from (2.5) in Theorem 2.1 that 

K(^) . 1 a(i-C) . ff ^ 

lim - . , — ->1 a.s. rfl 2; < 2(t Cj- 

Therefore, similar arguments as before yield that GV2 is given by (2.9). □ 

The latter result is a key step for the computation of EERoo(^) and 
FDR 00 (("). In practical examples it remains to determine the sets C^i and 
2 and to evaluate the corresponding integrals. 

2.2. Some LCP's equal to zero. If an LCP is equal to zero, the behavior 
of the FDR heavily depends on the gradient in zero of the c.d.f. of the p- value 
distribution. The next two lemmas cover the finite case. 

Lemma 2.2. Let a G (0, 1), < 7 < l/a, n ,n G N, n < n and let£i,. . . ,£ no 
be i.i.d. random variables with values in [0, 1] with c.d.f. satisfying F^(t) = 
"ft for all t G [0, a] . Furthermore, let £n +i; • • • ,£ n be random variables with 
values in [0, 1], independent of (£j :1 < j < no). For Cj = ia/n, i = 1, . . . ,n, 
define R' n = max{k < n:£ k:n < c k } and = \{i G {1, . . . ,n } :& < c R >J\ 
(with CR/ n = —00 for R' n = —00). Then 

(2.10) E ( *U=?V 



i? ' V 1 V n 



Proof. For 1 < i < no, denote the (n — l)-dimensional random vec- 
tor (£1 , . . . , , ,...,£„) by £W ; define for 1 < k < n the sets D%' (a) = 
{efcn-i > c fc+i - • • > c «i and set ^?(«) = 0, D%\<x) = n. Then 
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the left-hand side of (2.10) (cf., e.g., Lemma 3.2 and formula (4.4) in [13]) 
is equal to 

' l i=l i=l j=2 1 J 1 J J 

Noting that P(£j < c n ) = 7a for all 1 < i < uq and P(£j < Cj)/j = ^ya/n for 
all 1 < j < n, the assertion follows immediately. □ 

As an application of Lemma 2.2, we insert a surprising example. 

Example 2.3. Under the general framework of this section, suppose 
the Xi follow an exponential distribution with scale parameter A = 1 and 
location parameter $j and Z follows an exponential distribution with scale 
parameter A = 1 and location parameter 0, and consider the model Tj = 
g(Xi, Z) = Xi — Z , i = 1, . .. ,n. Under Hi'.'di = 0, the c.d.f. of Tj is given 
by W T {t) = exp(i)/2 for t < and W T (t) = 1 - exp(-t)/2 for t > 0, while 
the p- values (as functions of the observed z-value) are given by Pi(z) = 
1 — Wx{xi — z), i = 1,. . . ,n. This results in 

(2exp(-z)t, if < * < 1/2, 

Foo(t\z) = I exp(-z)(2 - 2t) -1 , if 1/2 < t < u(z), 
(l, iiu(z)<t<l, 

with u{z) = 1 — exp(— z) /2. For convenience, we restrict attention to the case 
a < 1/2. In order to apply Lemma 2.2, set F^(t) = -Foo(t|z) and note that 
Pi(z) has c.d.f. if Hi is true. Therefore, supposing that no hypotheses are 
true and ri\ = n — uq are false with fixed but arbitrary -&i > 0, we obtain with 
7(2) = 2exp(— z) and Cn = ^o/ n that FDR n (( n \z) = Cn&liz) for all z > 0. 
Integrating with respect to P z finally results in 

FDR n (C„) = Cna J 7 (z) dP z \z) = C„a. 

It may be astonishing that the Benjamini-Hochberg upper bound for the 
FDR is attained for all parameter configurations although the Tj's are de- 
pendent. Notice that the MTP2 property holds in this setting so that the 
Benjamini-Hochberg bound for the FDR applies. This is a consequence of 
Propositions 3.7 and 3.8 in [12], because the p.d.f. of the Exp(A) distribution 
is PF2 for any A > 0; see [11], page 30. 

The next result extends Lemma 2.2 and is a helpful tool in the case that 
LCP's are in 0. 

Lemma 2.3. Under the assumptions of Lemma 2.2 but only supposing 
that F/:{t) = -yt for all t £ [0,t*] for some t* £ (0,a], let A n (t*) = {F n (t) < 
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t/aiit G (t*, a]}, where F n denotes the e.c.d.f. o/£i,...,£ n - Then, setting 
r = max{i G No : ia/n < t*}, 

(2 - u > E (i^VT^-<"))=lf^ p(D!11( °»- 

Proof. It is clear that A n (t*) = {R' n < r}; hence, for r > 0, the left- 
hand side of (2.11) is now equal to 



J:E p ^<^)P(^ ) («)) + EE 

i=l i=lj=2 



j ~ 1 J 

The assertion follows similarly as in the proof of Lemma 2.2. □ 



The following theorem, the proof of which is in the Appendix, is an im- 
portant step for the understanding of the limiting behavior of both EER (or 
ENE) and FDR given a fixed value Z = z such that the LCP is in 0. 

Theorem 2.3. Given D-EX{Q n ) with lim^ooCn = 1, let z G Z be such 

that Foo(t\z) < t/a for all t G (0,a]. Setting 7(2) = lim t _ >0 + F OQ (t\z)/t, it 
holds that 

(2.12) EER 0O (l|2;) =0, 

(2.13) FDR 00 (l|z) = ary(z). 

Remark 2.4. In [8] the distribution and expectation of V n were com- 
puted for uniform p-values under the assumption that all hypotheses are 
true. Assuming Q n = \ for all n G N, the nesting method in the proof of 

(2.13) together with the technique in [8] can be used to prove 

{ a'f(z) 
(l-«7(^) 2 ' 7 ^ <1/a ' 
oo, j(z) = l/a. 

It is important to note that this formula is only valid for ^ n = 1. If n\ tends 
to infinity with lim n _» 00 ni/rt = and 7(2) > 0, then lim n _ >co E[V^(z)] = 00. 

To complete the picture for £ = 1, the next theorem puts things together. 

Theorem 2.4. Given D-EX(( n ) with lim n _ >00 ( n = 1, suppose that Foo(t\z) 
is strictly decreasing in z for t G (0,a). Moreover, let G\ t \ and C\ t i be de- 
fined as in Theorem 2.2 and let Eq = {z G Z:t{z\\) = 0} and E\ = Z\Eq. 
Then 

(2.14) EER co (l)= f udG 1A (u), 

(2.15) FDR 00 (l) = P z ( J B 1 ) + a / 1 (z)dP z {z). 

J En 
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Proof. Using the disjoint decomposition Z = Eq + E\, we obtain 
EER DO (l)= lim / ^^dP z (z) 

= [ lim YM dP z {z)+ f liui YM P z {z) 

J Eo n->oo n J El n->oo n 

= A 1 + A 2 (say). 

Now, Theorem 2.3 immediately yields A\ = 0, and in analogy to the ar- 
guments in the proof of Theorem 2.2, we get that A 2 = J Cl ^{q} ttdGi 5 i(u). 
Therefore, (2.14) is proven. Applying the same decomposition (together with 
Theorem 2.3) to FDRoo(l) and observing that lim^oo V n (z)/(R n (z) V 1) = 1 
if z G Ei [similar to (2.5) with £ = 1] finally proves (2.15). □ 

3. Exchangeable normal variables (Example 2.1 continued). In the D- 

EX-N(£ n ) model, assuming that the proportion ( n of true null hypotheses 
tends to 1, we obtain from Lemma 2.1 that the limiting e.c.d.f. of the pi's 
given Xq = x$ is given by 

Foo(t\x ) = 1 - - t)/v^+ \fp/j>x ) for all t G (0, 1), 

and Foo(0|x ) = 1 - F^^xo) = 0. Note that F^xo) = P(V^X - 
^/J)Xq > ui-t), where X denotes a standard normal variate and u a denotes 
the corresponding o-quantile. Moreover, it is lim t io(d/dt)F 00 (t\xQ) = 
]im.f\i(d / dt)Foo(t\xo) = 0, and FooH^o) is convex for < t < <&{xq/ *j~p) and 
concave for ^(xo/^/p) <t<l. Furthermore, -Foo^l^o) is strictly decreasing 
in xo for t G (0, 1) and lim p j -^oo^l^o) = t- 

Assuming that hin^^oo Q n = ( G (0, 1] , the limiting e.c.d.f. is given by 

F oo (t\x ,() = {l-() + (F oo (t\x ). 

Hence, for ( G (0, 1] and given t G (0, a), Foo(t\xo, Q =t/a iff 

(3.1) xo = x (t\o = v^/p^ _1 ((i - <A*)/C) - - ty^p. 

For ( G (0, 1), we get lim na{1 _ f) x (t\() = +oo and lim iTa x (t|C) = -oo. 
Moreover, -FooH^ch starts above the Simes-line so that there is at least one 
CP in (0,1). In fact, there may be one, two or three points of intersection 
in (0,1). For £ = 1, we get in contrast to £ G (0,1) that lim^ x o(t\() = 
lim t -|- a xo(t|C) = — oo- The limiting e.c.d.f. -FooH^o) = -FooH^tb 1) starting 
with -Foo(0|xo) = may have no, one or two CP's in (0, 1). 

In order to determine the set of LCP's, the following derivations are help- 
ful. Let u = $ _1 (1 - t) and let 

(3.2) d(u\x , C) = (1 - C) + C(l - Hu/VV + y/p/pxo)) - (1 - $(u))/a 



DEPENDENCY AND FDR: ASYMPTOTICS 



13 



denote the distance between the transformed .Foo-curve and the transformed 
Simes-line. Then the conditions 

(3.3) d(4c ,C) = 0, 

(3.4) A d ( n | XOiC ) = o 

are necessary and sufficient for a TP (F^ touches the Simes-line). Note that 
condition (3.4) is equivalent to 



(3.5) u G {ui i2 (x ) = -xq/ y/p±y/p/py/x%-2 ln(y/p/ (a())}. 

If there exists a real solution u* of (3.3) and u* = U2(xq) = —x^j^fp — y/p/p x 

y 1 Xq — 21n(- v /p/(a£)) for given values of xq,p, (, then we define t<i = 
1 — $(n*). If such a solution u* exists in case of £ G (0,1), define t\ as 
the smaller solution of -Foo^l^cC) =t/a. Then the set of LCP's is given 
by = (a(l — C)i*i) U (t2,a). Note that for £ = 1 there exists a unique 
TP such that the set of LCP's is given by = {0} U (t2,a). Furthermore, 
for (" G (0, 1), there may be no such TP. In the latter case, formally inter- 
preted as t± = ^2, we have = (q(1 — (),a). For example, such a situa- 
tion occurs in the case p> {aQ 2 and a G (0,1/2] iff d(u2(x )|x , C) > for 



£ = -V 21n (vW«))- 

The (discontinuous) case t\ < t2 looks somewhat paradoxical. In this case, 
depending on the observed xo, either a small proportion tti G ((1 — Q,t\/a) 
or a larger proportion tt2 G fo/a, 1) of hypotheses will be rejected although 
the distance between the corresponding xq values may be small. This occurs, 
for example, for a = 0.1, £ = 0.9999. 

The following two theorems give formulas for EERqo and FDRqo. The 
first theorem covers C G (0, 1), the second one £ = 1. The proof of Theorem 
3.1 can be found in the Appendix, while the proof of Theorem 3.2 is a 
straightforward application of Theorem 2.4. 

Theorem 3.1. Given model D-EX-N(( n ) with lim n ^ooCn = £ £ (0,1), 
the set of LCP' 's is = (a(l — £), ii) U (£2, a) for t\ < t2 and = (a(l — 
C),ct) fort\ = t2 (i.e., no TP) and 

EERoo(C) = ^i<I>M*i|C)) 
a 



+ 



[ tl/a <S>{x (at\())dt+ f 1 $(x (at\0)dt, 

Jl-( Jt 2 /a 



FBR oo (C) = (z 2 -z 1 )^(x ( " (1 C) C 



--i 



+ / $ xo 







1-Z1 



1 - z 



C))dz+I ^[xo[^ rr fC))dz, 
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Fig. 2. EER 00 (C) in the D-EX-N(( n ) model for a = 0.05 and ( = 0.1, 0.2, 0.3, 0.4, 0.5 
(left picture) and C, =0.6, 0.7, 0.8, 0.9, 0.95, 0.975, 1 (right picture). 

where Zi = 1 — a(l — C)A« > * = 1)2. 

Theorem 3.2. Given model D-EX-N(C, n ) with lim^^oo^n = C = 1. ^ e 
sei 0/ ZCP's is C c = {0} U (t 2 ,a) and 

EER 00 (1) = t 2 ^(x (t 2 \C))/a + f 1 $(x (at\O) dt, 

Jt 2 /a 

FDR oo (l) = $(x (t 2 |C))- 

Remark 3.1. For £ = 1, we obtain an upper bound for ccofeIC) an d 
FDR QO (l), respectively, if p < 1 — a 2 . From the derivations before Theorem 

3.1, we get xofoK) < x = —^2 \i\{^/p/a) and consequently, FDRoo(l) < 
^(■£o)- This is helpful for the numerical determination of xoC^IO- 

The following interesting and maybe unexpected result, which will be 
discussed in Section 5, concerns a discontinuity for ( = 1 and p — > 0. The 
proof is given in the Appendix. 

Theorem 3.3. Given model D-EX-N(( n ) with lim n ^ooCn = C = 1 
a € (0,1/2], 

(3.6) lim FDRoo(l) = J-21n(a)). 

p->0+ v 
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Figures 2 and 3 display EER 00 (^) and FDR oo (0, respectively, for various 
values of £ for p € [0, 1]. For p -> 0, EER 00 (C) tends to a(l - - a() as 
expected (cf. [7]) and for p— > 1, EERoo(£) tends to Qa. Moreover, it seems 
that EER oo (0 is increasing in p with largest values for large p and C- If 
p is not too large (< 0.9), EER^C) is largest for C~ 1/2. For ( G (0,1), 
FDR tends to the Benjamini-Hochberg bound for p — ► and p—*l. For 
p = 1, we have total dependence so that FDR n (£ n ) = Cn« in the D-EX-N(£ n ) 
model. For large values of £, the computation of FDRoo(^) is extremely 
cumbersome. The main reason is that the TP's are very close to so that 
an enormous numerical accuracy is required. Finally, it is interesting to note 
that for £ = 1, FDRoo(l) reflects the limiting behavior of the true level of 
Simes' [15] global test for the intersection hypothesis. Our results imply that 
this global test has an asymptotic level greater than zero for all correlations 
p 6 [0, 1], which is a new finding. 

4. Studentized normal variables (Example 2.2 continued). In the D-EX- 

t(Cn) model with lim^ooCn =(=1, ^oo(-|s) is given by 

F^s) = 1 - HsF t -\l - t)) = 1 - *( a t„,i_ t ). 

Note that -Foo(i|s) is decreasing in s for t < 1/2 and increasing in s for 
t > 1/2. Moreover, (d/dt)Foo(t\s) = sip{st v j_- t )/ ft„{t v ,i-t), hence, we get 



FDR^{<) 
005—1 




P f CurrcluHuii) 




P [C urrclMLoii] 



Fig. 3. FDRoo«) m the D-EX-N(( n ) model for a = 0.05 and £ = 0.1, 0.2, 0.4, 0.6, 0.8, 
0.9 (left picture) and ( = 0.95, 0.96, 0.97, 0.98, 0.99, 0.995, 0.999, 0.9999, 0.99999, 1 
(right picture). 
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lim n o(<9/d£)^oo(t|s) = ]im tn (d / dt)F ao (t\s) = 0. Moreover, 
^ Foo (t\s)>0 iff - s h v ^ t < f j%^ 




This condition is equivalent to 



v+1 



( 



) 



-i 




1 + 



u,l-t 



V 



V 



Hence, for t < 1/2, F^^s) is convex for t < mm{l/2,F tl/ (— a(s,u))} with 
a(s,u) = ((u + l)/s 2 — v) 1 / 2 and concave otherwise. For t > 1/2, -Foo(i|s) 
is convex for t < max{l/2, F± v (a(s, z/))} and concave otherwise. Notice that 
F 00 (l/2|s) = 1/2 for all s > 0. As a consequence, for a < 1/2, crosses the 
Simes-line at most if F tv {—a{s,v)) < 1/2, which happens if s 2 < (v + 1)/za 
Given the D-EX-t(£ n ) model with XwOn-^oo^n = C S (0,1], the limiting 
e.c.d.f. is given by 



For convenience, we restrict attention to a G (0, 1/2] in the remainder of this 
section. For £ G (0, 1], we have Foo(£|s, £) = V a ^ 



where s(i|C) > iff t < a(l — C/2). Therefore, LCP's are only possible in 
[i u ,i ] with t u = q(1 — C) and t Q = a(l — C/2). Notice that lim t ^ tu s(t\() = 
lim tTto s(t\() = for ( = 1, while lim^ s(t\() = oo and lim tTto s(t\Q = for 
C G (0, 1). For C G (0, 1), the set of LCP's consists of one or two intervals 
denoted by (a(l — C)>*i) anci (*2,«(1 — C/2))- If there exists a TP we have 
t\ < t<i and the TP is ti\ otherwise t\ =t2- In the case C = 1 the existence 
of a TP (denoted by £2) is guaranteed and the set of LCP's is given by 
C\ = {0} U (t2, a/2). Hence, the situation is quite similar to the D-EX-N(£ n ) 
model in Section 3 except that there are no crossing points at all in [i 0) Q!]- 
With u = i^ -1 (l — t), the distance function between Foo and the Simes-line 
is defined by d u (u\s, C) = (1 — C) + C(l ~~ &(su)) — F tv (—u)/a. Necessary and 
sufficient conditions for a TP (i 7 ^ touches the Simes-line) are now given by 



which are equivalent to a$(— su) = Ft v {—u) and saip(su) = ft„(u). 

We summarize the behavior of EER and FDR in the following two theo- 
rems in analogy to the results of Section 3. 



Foo(t\s, C) = (1 - C) + C(i - HsF t ~\l - t))). 



s = s(t\Q 



■5>-\{l-t/a)/Q 
F t ~\l-t) 



d u (u\s,() = ® and tt~ d v (u\s, Q = 0, 
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Theorem 4.1. Given model D-EX-t(( n ) with lim^ooCn = C £ (0,1) 
and a G (0,1/2], the set of LCP's is C c = (a(l - C),*i) U (t 2 ,a(l - C/2)) 
/or t\ < t2 and = (a(l — (),a(l — C/2)) for t\ = t 2 (i.e., no TP) and 

EER oo (0 = t ^^F Xv {^s{t l \Q) 



a 



+ 



+ 



ti/o 
i-C 

l-C/2 



FDR 00 (C) = (^-zi)F x „ (v^s 



F Xv {y/Ds{at\Q)dt 
F Xu {^s(at\C))dt, 



a(l-C) 



a(l-C) 



+ 



=2 



1-z 

a(l-C) 



1 



dz 
dz, 



where z% = 1 — a(l — Q/U , i = 1,2, and Z3 = Q/(2 — £). 

Theorem 4.2. Given model D-EX-t(( n ) with lim n _ 
a G (0, 1/2], i/ie set of LCP' 's is C c = {0} U (i 2 , a/2) and 



, Cn = C = 1 and 



EER QO (l) = t 2 F x „(V^s(t 2 \())/a+ [' F Xv (V^s(at\()) dt, 

Jt 2 /a 

FBR OQ (l)=F Xu (^s(t 2 \C)). 



Finally, for £ = 1 , we consider the case that the degrees of freedom v tend 
to infinity. Heuristically, this means that the model tends to independence. 
In contrast to the normal case of the previous section, the solution is more 
difficult. The reason is that one has to find suitable asymptotic expansions 
for ft v and Ft v given in [4]. Application of these expansions yields the fol- 
lowing result, the proof of which is given in the Appendix. 

Lemma 4.1. Let a G (0, 1/2] and define 

s = Su (x) = 1 - v~ x l 2 (- ln(x)) 1 / 2 + o(^" 1/2 ), x G (0, 1/2]. 

Then, given model D-EX-t(Q n ) with lim ri _ >00 £n = C = 1, it holds for suffi- 
ciently large v that F OQ (-\s v (x)) has (\) two CP's for all x G (0, a), and 
no CP for all x G (a, 1 /2] . 

Application of this lemma yields the same limit of the FDR for ( n — > 1 
and v — > 00 as in Theorem 3.3; cf. the discussion in Section 5. 
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Fig. 4. EER OQ (C) in the D-EX-t(( n ) model for a = 0.05 and C = 0.1, 0.2, 0.3, 0.4, 0.5 
(left picture) and ( = 0.6, 0.7, 0.8, 0.9, 0.95, 0.975, 1 (right picture). 



Theorem 4.3. Let a £ (0,1/2]. Then, given model D-EX-t(C, n ) with 
lim^ooCn = 1, 



(4.1) 



lim FDR 0O (l) = $(-J-21n(a)). 



Proof. The result follows by letting x — > a in Lemma 4.1 and by ap- 
plying the central limit theorem. Setting s u = s v (a), we get 

lim FDRoo(l) = lim P(S < s u ) 

i/— >oo v— >oo 

„ / uS 2 — V US 2 — V 
= lim P =- < v -= 

_ , im P (^JL 



<-V-21n(«) + o(i; 



*(-J-2In(a)). 



□ 



In analogy to Section 3, Figures 4 and 5 display EER 00 (C) and FDR 00 (^), 
respectively, for various values of £ and v. It seems that EER oo (0 is decreas- 
ing in v. For v — ► oo, EERoo(£) again tends to the value a(l — £)/(l — a£) 
as expected; see [7]. Note that EERoo(£) is already close to this limit if v 
is not too small. As expected, for £ ~ 1/2 and v not too small, EER oo (0 is 
largest. Except for £ = 1, the FDR tends to the Benjamini-Hochberg bound 
£a for increasing degrees of freedom. The limit for v — > is not clear. In 
the latter case the density of the ^distribution becomes flatter and flatter 
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and the computation of FDRoo(^) becomes extremely difficult. As in the 
D-EX-N(£ n ) model with £ n — > 1, FDR 00 (1) reflects the limiting behavior of 
the true level of Simes' [15] global test for the intersection hypothesis and 
again, our results show that it is asymptotically greater than zero for all 
u>0. 

5. Concluding remarks. The investigations in this paper show that the 
false discovery proportion FDP= V n /[R n V 1] of the LSU-procedure can be 
very volatile in the case of dependent p-values, that is, the actual FDP may 
be much larger (or smaller) than in the independent case. The same is true 
for V n , V n /n, R n and R n /n. Under mild assumptions, the e.c.d.f. of the p- 
values converges to a fixed curve under independence (cf. [7]), which implies 
convergence of V n /n and R n /n to fixed values. On the other hand, the shape 
of the e.c.d.f. of the p-values under exchangeability heavily depends on the 
(realization of the) disturbance variable Z; cf. Figure 1. In the latter case, 
the limit distribution of V n /n and R n /n typically has positive variance. 

It is often assumed that there may be some kind of weak dependence 
between test statistics (cf., e.g., [16]), being close to independence in some 
sense. The results in Theorems 3.3 and 4.3 and the numerical calculations 
reflected in Figures 3 and 5 suggest that for large n and Q n — > 1 small devi- 
ations from independence (small p or large v) may result in a substantially 
smaller FDR than the Benjamini-Hochberg bound. However, simulations 
for small p and large v show that FDR n (£ n ) approaches its limit FDR oc (l) 
only for unrealistically large values of n if £ n — > 1. For example, in the D-EX- 
N(Cn) model with a = 0.05, n = 100,000 and p = 0.1, we obtained FDR n (l) « 
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Fig. 5. FDRoo(C) in the D-EX-t((„) model for a = 0.05 and £ = 0.1, 0.2, 0.4, 0.6, 0.8, 0.9 
(left picture) and ( = 0.9, 0.95, 0.99, 0.999, 0.9999, 1 (right picture). 
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0.0417 by simulation. For p = 0.01, we got FDR„(1) « 0.05. A possible ex- 
planation may be that limp^ + FDR n (l) = a, lim^^oo FDR n (l) = a, hence, 
the order of limits plays a severe role. Moreover, for small p, it seems that n 
has to be very large such that the e.c.d.f. reproduces the shape of close 
to 0. For £ < 1, the FDRqo curves in Figures 3 and 5 reflect the FDR for 
realistically large n (e.g., n = 1000) very well. The reason is that the shape 
behavior of close to is not that crucial as for £ = 1 . 

Example 2.3 shows that the FDR under dependence may also have the 
same behavior as in the independent case. Therefore, it seems very difficult 
to predict what happens with EER, FDR and FDP in models with more 
complicated dependence structure, for example, in a multivariate normal 
model with arbitrary covariance matrix. In any case, results of the LSU- 
procedure, or more generally, of any FDR controlling procedure, should be 
interpreted with some care under dependence, taking into account that the 
FDR refers to an expectation and that the procedure at hand may lead to 
much more false discoveries than expected. 

In the models studied in Sections 3 and 4, the EER becomes smallest if 
i?i -> 0+ for all i G I x and tends to CnEER n ,(l), where h = {j : Kj 3&j}. It 
is not clear for which parameters $j the FDR becomes smallest. However, if 
&i -» 0+ for alH G h, Cn -»■ C € (0, 1), the FDR tends to CFDR oc (l). 

Finally, with slight modifications of the methods developed in this paper, 
one can also treat statistics like Tj = \Xi — Z\ or Tj = \Xj\/Z. Somewhat more 
effort will be necessary if the disturbance variable Z is two-dimensional as, 
for example, in Tj = \Xi — Z\\/Z2- 

APPENDIX: PROOFS 

Proof of Theorem 2.3. The assumptions concerning imply that 
lim n _ >00 i? n (2;)/n = almost surely. Noting that V n {z)/n < R n (z)/n for all 
n G N, (2.12) is obvious. 

In order to prove (2.13), we nest -F^ between two c.d.f.'s being linear 
in a neighborhood of zero. To this end, let t* £ (0,a] be fixed, B = [0,i*), 
me(t*) = inf tGB \ {0} Foc(t\z)/t, m u (t*) = sup teB \ {0} Foo(t\z)/t, and 

F e {t) = m e (t*)t • l B (t) + FooQlz) • l B =(i), 

F u (t) = m u (t*)t ■ l B (t) + max{m u (t*)t* , F^z)} ■ l B °(t). 

This results in F £ (t) < F^z) < F u (t) for all t G [0, 1]. For n G N, let the 
event A n {t*) be defined as in Lemma 2.3. Then 

FDRJCnk) = E( K( , Z) \ a +e( V ?[ Z) l A c(t*)) 
= A n + A n (say). 
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With r n = maxji € No : ia/n < t*}, we obtain similarly to the arguments in 
the proof of Lemma 2.2 that 



A n = E 



r„ 



Vn(z) 



Due to the pointwise order of Fg, and F u , we get 

C„m<(OaP(DW(a)) <A n < ( n m u (t*)aP(Dff (a)), 
Cnm^i^aP (£>«(«)) + A n < FDR n (( n \z) < C n m u (t*)aV{D^{a)) + \ n . 

Since ( n -»■ 1, P( J D^ l ) (a)) -» 1 and P(Ai(**)) -> 1 for n — > oo, we obtain 
A n ->■ and me(t*)a < liminf^oo FDR n (( n \z) < limsup^^ FDR n (( n \z) < 
m u (t*)a. The assertion now follows by noticing that lim t *_ >0 + m e(t*) = 
lim t *^ 0+ m u (t*) =i(z). □ 

Proof of Theorem 3.1. Denote the p.d.f. corresponding to G^i by 
<7£ i and notice that C^i = (0, t±/a — (1 — £)) U (£2/0 — (1 — C)j0- From 
Theorem 2.2, we get 

. tl / a -(i-C) K 
EER 00 (C)=/ ugr 1 (u)du+ ugri(u)du. 

Jo Jt 2 /a-{i-0 

Since xo(*i|C) = a^o (*2 1 C) an d lim^ a xo(t\() = — oo, we get 

EER 0O (C) = (h/a - (1 - C))(l - $Oo(ii|C))) + C 

- (t 2 /a - (1 - C))(l - *(s (ti|C))) - (h/a - (1 - 0) - C 

/•ti/a-a-C) 

+ i 2 /a - (1 - C) + / $(x (a(n + 1 - C) 10) du 

Jo 

+ [ C $(so(a(«+l-C)|C))<*« 
Jt 2 /a-(l-Q 

a 

+ f lf <f>(x (at\())dt + [ <f>(x (at\())dt. 
In order to compute FDR^C), note that, for z £ (0, z\) U (z2,C)> 
G W (*) = l-*(*of^|C 
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where Zi = 1 — a(l — () /U , i = 1,2. In view of ]im t ^ a (i_Q xo(i|C) = oo, it is 
£^,2(^1) = ^2(22), G^ 5 2(0) = and G^^iC) = 1- Denoting the corresponding 
p.d.f. of G<^2 by g^2i we obtain 

FDR 00 (C)=/ zg^ )2 {z)dz+ zg^ t2 (z)dz 
Jo Jz 2 

= ziG Cj2 (zi) + CG C , 2 (C) - ^GfoCza) 
G c , 2 (z)dz- [ G c>2 (z)dz 



(22 _ 21)$W ^| C) ) 



/■< / /a(l-C) 



1-z 



□ 



Proof of Theorem 3.3. For any p G (0, 1), there exists a unique so- 
lution (u,xq) = (u p ,XQ tP ) (say) of (3.3) and (3.4). In view of (3.5) and the 
shape of F^, (u p ,xo )P ) satisfies 



(A.l) Up = -xo.p/Vp - \fpfp\l xl p - 2 ln( y/p/a) . 

Notice that a G (0,1/2] implies u p > and therefore, xo,p < 0. Now, for 
5 G (0,a), we consider xo = Xq(6) = — \J — 21n(<5) < — ^/— 21n(a) = xo(a) in 
order to bound xo,p from below for p — > + . Since tip has to be a real number, 
we obtain from (A.l) that limsup p ^ + x o,p < x o( a )- Defining 

-a ((5) u(pj) /p 
u = u{p, 0) = and w = w(p,d) = = — \- . —Xo{o), 

^/P VP VP 

we get from (3.2) that d(n|xo, 1) = 3>(— w) — <&{—u)/a. Hence, d(u\xo, 1) > 
iff <&(— id) < a. Employing the asymptotic relationship $(— x)/(p(x) ~ 
1/x (» — ► 00) for Mills' ratio, we get 

~ -^H = - ex p((™ - " 3 )/2 ■ 

Since exp((w(p, S) 2 — u(p, 5) 2 )/2) = 5 < a independent of p and lim p ^ + w (pi 
S)/u(p,5) = 1, we conclude that lim p _ >0 + xq iP = x (a) = — y / — 21n(a). This 
finally implies (3.6) and completes the proof. □ 

Proof of Lemma 4.1. For s 2 <(u + the unique point of inflec- 
tion of Foo(-|s) on (0,1/2) is given by t*(w\s) = F tv {—a{s,v)) with a(s,u) = 
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{(y + l)/s 2 — v) 1 / 2 . Hence, it suffices to show that 

Foo{t* {v\s u (x))\s v {x)) > t*{v\s u (x))/a for x G (0,a) 

for sufficiently large v and that the derivative of F OQ (-\s v (x)) in t = t* {v\s v {x)) 
is less than 1/a for all x G (a, 1/2] for sufficiently large v. Therefore, the as- 
sertion follows if 

(A.2) lim J^(-aMz)^)) < Q for x £ (Q a) 

(A.3) lim ftMs v (x),v)) >a for x G (a, 1/2]. 
For G (0, oo) with lirn I/ _, [>0 x„/u = f3 G [0, oo], it is shown in [4] that 
lim lim m^ = exp(/3/4). 

u^co ip{x v ) <P(— X v ) 

Note that for u — > oo and s — > 1, it holds that (Mills' ratio) 

FtA-u) F tv (-u) <p(u) 
$(— su) $(-u) (p(su) 

We easily get lim^oo a(s„(x), v) A /v = lim^oo a(s u (x), u) 2 (l - s u (x) 2 ) = -41n(x). 
As a consequence, (A.2) follows by noting that 

lim Ft v (-a(s v (x),i/)) 

'Ft v (-a(s v (x),u)) ip(a{s v (x),v)) 



$(-a(s u (x),v)) <p(s v (x)a(s„(x), v)) 
1 
2 



lim 

v— >oo 

exp(— 41n(x)/4) lim exp (— —a(s u (x), ^) 2 (1 — s v (x) 2 \ 



= — exp(2 ln(x)) = x. 

x 

An analogous calculation yields (A.3). Hence, Lemma 4.1 is proved. □ 

Acknowledgments. The authors are grateful to a referee and an Asso- 
ciate Editor for their constructive and valuable suggestions and their quick 
replies. Thanks are also due to the editor M. L. Eaton for his expeditious 
handling of the manuscript. 

REFERENCES 

[1] Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: A 
practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 
57 289-300. MR1325392 



24 



H. FINNER, T. DICKHAUS AND M. ROTERS 



[2] Benjamini, Y. and Yekutieli, D. (2001). The control of the false discovery rate in 
multiple testing under dependency. Ann. Statist. 29 1165-1188. MR1869245 

[3] Eklund, G. and Seeger, P. (1965). Massignifikansanalys. Statistisk Tidskrift Stock- 
holm 3 355-365. 

[4] Finner, H., Dickhaus, T. and Roters, M. (2008). Asymptotic tail properties of 

Student's t-distribution. Comm. Statist. Theory Methods 37. To appear. 
[5] Finner, H. and Roters, M. (1998). Asymptotic comparison of step-down and step- 
up multiple test procedures based on exchangeable test statistics. Ann. Statist. 
26 505-524. MR1626043 
[6] Finner, H. and Roters, M. (2001). Asymptotic sharpness of product-type inequal- 
ities for maxima of random variables with applications in multiple comparisons. 
J. Statist. Plann. Inference 98 39-56. MR1860224 
[7] Finner, H. and Roters, M. (2001). On the false discovery rate and expected number 

of type I errors. Biom. J. 43 985-1005. MR1878272 
[8] Finner, H. and Roters, M. (2002). Multiple hypotheses testing and expected num- 
ber of type I errors. Ann. Statist. 30 220-238. MR1892662 
[9] Genovese, C. R. and Wasserman, L. (2002). Operating characteristics and exten- 
sions of the false discovery rate procedure. J. R. Stat. Soc. Ser. B Stat. Methodol. 
64 499-517. MR1924303 

[10] Genovese, C. R. and Wasserman, L. (2004). A stochastic process approach to false 
discovery control. Ann. Statist. 32 1035-1061. MR2065197 

[11] Karlin, S. (1968). Total Positivity 1. Stanford Univ. Press. MR0230102 

[12] Karlin, S. and Rinott, Y. (1980). Classes of orderings of measures and related 
correlation inequalities. I. Multivariate totally positive distributions. J. Multi- 
variate Anal. 10 467-498. MR0599685 

[13] Sarkar, S. K. (2002). Some results on false discovery rate in stepwise multiple 
testing procedures. Ann. Statist. 30 239-257. MR1892663 

[14] Seeger, P. (1966). Variance Analysis of Complete Designs. Some Practical Aspects. 
Almqvist and Wiksell, Uppsala. MR0223020 

[15] Simes, R. J. (1986). An improved Bonferroni procedure for multiple tests of signifi- 
cance. Biometrika 73 751-754. MR0897872 

[16] Storey, J. D., Taylor, J. E. and Siegmund, D. (2004). Strong control, conserva- 
tive point estimation and simultaneous conservative consistency of false discov- 
ery rates: A unified approach. J. R. Stat. Soc. Ser. B Stat. Methodol. 66 187-205. 
MR2035766 



H. Finner 
T. Dickhaus 

German Diabetes Center 

at the Heinrich-Heine-Universitat Dusseldorf 
Institute of Biometrics and Epidemiology 
Dusseldorf 
Germany 

E-MAIL: finner@ddz.uni-ducsscldorf.dc 

dickhaus@ddz.uni-ducsscldorf.dc 



M. Roters 

Omnicare Clinical Research 
Biometrics Department 
Koln 
Germany 

E-MAIL: Markus.Rotcrs@omnicarccr.com 



